The unreasonable accuracy of the Jastrow approach in many-body physics 



m 
o 
o 

(N 



Niels R. WalelE and R. F. Bishoil] 

Department of Physics, UMIST, P.O. Box 88, Manchester M60 IQD, UK 
(Dated: 2nd February 2008) 

We investigate in a simple model whether a Jastrow-based approach for a many-body system 
containing two-body interactions can be exact. By comparison with recent assertions to the contrary, 
we find that in general the exact wave function is not purely two-body correlated. Nonetheless, we 
show that the energy estimate obtained from the calculations is as accurate as it can possibly be, 
suggesting why Jastrow wave functions are such a good choice. 

PACS numbers: 31.15.Pf,71.10.-w,31.10.+Z,31.25.Eb 



CI,. 



q 

O 

^ ■ 

Oh- 



> 

On 

O . 
I> ■ 

O ■ 

m 

o 

Oh 



X 



A long-standing and ongoing fundamental problem in 
quantum physics is the search for general methods to pro- 
vide accurate descriptions of strongly interacting systems 
with many degrees of freedom, starting from a micro- 
scopic Hamiltonian. One of the first such broadly based 
techniques, which is still in widespread use, was intro- 
duced by Feenberg 0. He generalized a similar varia- 
tional approach of Jastrow |2] , the basic idea of which is 
that in a strongly correlated A^-body system the wave 
function may be approximated as the product of two 
parts. The first is a simple "uncorrelated" part which 
incorporates the correct quantum statistics (e.g., a Slater 
determinant for fermions). The second describes the cor- 
relations and is a product of pairwise Jastrow factors, 
which depends only on the interparticle separations. 

Many, if not most, of the key methods in modern quan- 
tum many-body theory are based on similar ideas, but 
often with simple but subtle differences which have deep 
implications, as we elaborate below. For example, the 
variational Monte Carlo (VMC) method often employs 
a parametrized Jastrow-correlated wave function which 
is optimized using a statistical approach. Although the 
VMC method is not intrinsically tied to Jastrow wave 
functions, their usefulness has been proven empirically by 
the high level of accuracy that can be reached with such 
a simple form of trial wave function in many applications 
in nuclear physics and elsewhere Many authors in 
many different fields have attempted to understand the 
surprisingly accurate results obtained by Jastrow trial 
wave functions. For example, Gaudoin et al. Q have 
shown how by generalizing the random phase approxi- 
mation of the electron gas to the inhomogeneous case, a 
Slater- Jastrow trial wave function arises rather naturally. 
They also showed how the uncorrelated Slater determi- 
nant contains optimal orbitals which are close both to 
standard Hartree-Fock orbitals and to orbitals obtained 
from density-functional theory within the local density 
approximation, even though neither of these latter ap- 
proaches includes Jastrow factors a priori. 

Although the use of such simple Jastrow-correlated 
many-body wave functions has been seen to give a large 
part of the correlation energy in many diverse applica- 
tions, one would also like to improve the method. Sev- 



eral such refinements have been widely used. Firstly, 
one may extend the two-body correlations to depend 
also on internal quantum numbers such as spin. This 
is particularly important in cases where the interactions 
are state-dependent, such as in nuclear physics. State- 
dependence in the two-body correlators turns them ef- 
fectively into operators. The fact that the parameters 
of a given particle occur in many of the Jastrow factors 
then leads to them not commuting between themselves, 
and hence the product of N{N — l)/2 correlation oper- 
ators needs to be symmetrized. This considerably com- 
plicates the formalism, and the Fermi hypernetted chain 
(FHNC) method is one approach that deals with it. 
It is based on a cluster expansion of the Jastrow cor- 
relations, and the method has proven to be quite accu- 
rate. An alternative to the FHNC method for Hamil- 
tonians which include tensor and other spin-dependent 
interactions has been developed by Schmidt and Fantoni 
0, using a purely numerical approach. A second exten- 
sion of the simplest Jastrow scheme is the inclusion of 
the product of all 3-body scalar cluster correlation func- 
tions, Yli^j^k f('^ij^'''jk,'rki), and similar products of n- 
body cluster correlation functions with n > 3, as well as 
the Jastrow product of all 2-body correlation functions, 
Wi^j fi^ij). Thirdly, the more general method of cor- 
related basis functions (CBF) 0,Bl3, 

which employs a 

correlated basis rather than a single trial wave function as 
above, is one of the two most successful universal many- 
body methods available today. The correlation operator 
in CBF calculations is commonly taken as a product of a 
state-dependent part and a scalar Jastrow- Feenberg part. 

The main competitor to the many-body techniques 
outlined above is the coupled cluster method (CCM) 
[^. It is based on describing the correlations in terms 
of exponentiated independent excitations, which are 
parametrized as multiconfigurational creation operators 
with respect to some suitable reference state. The CCM 
thereby completely avoids the complications arising from 
the overlapping products of correlation functions inher- 
ent in the Jastrow method. A huge advantage is that 
it is now much easier to deal with state dependence, 
since the issue of non-commutativity of the correlation 
operators never arises. A corresponding disadvantage is 
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that it is much more difficult to deal with such extreme 
correlations as arise in hard-core systems in the second- 
quantized representation that provides the natural frame- 
work for the CCM than it is in the first-quantized rep- 
resentation in which the Jastrow and CBF methods are 
most naturally expressed. 

Both the CBF method and the CCM have been widely 
applied in many different areas of quantum many-body 
physics outside the field of nuclear physics to which both 
can trace their origins. For example, the CCM has found 
many applications in quantum chemistry, where it is the 
method of first choice for very accurate descriptions of 
highly correlated atoms and molecules (see, e.g., Ref. 
21) . Recently, in this context, an attempt was made 
lOj l to extend the CCM to include more general excita- 
tions than those generated by exponentiated independent 
two-particle /two-hole excitations. 

This extension is tantamount to the use of state- 
dependent Jastrow wave functions, although the equa- 
tions to be solved differ slightly from the usual varia- 
tional ones, as discussed more fully below. There are 
now claims in the literature that this method can give 
the exact ground state wave function for systems inter- 
acting via pairwise forces 0, 0| . We shall argue here 
that although the method can certainly be extremely ac- 
curate, it is not in general exact. 

Our fundamental concern is thus twofold: why is the 
Jastrow method so accurate, and what limits its accu- 
racy? One obvious such limit is clearly any constraint on 
the parametrisation of the correlation functions. How- 
ever, the key issue is that even if we use the most general 
parametrisation possible, can the Jastrow method be ex- 
act? In view of our earlier discussion, it would clearly be 
surprising if it were always exact, but in recent papers 
Nooijen jlflj and Piecuch and his collaborators [ll| have 
claimed that this is the case. Their basic idea is to work 
in a finite part of occupation-number space, and obtain 
equations for the coefhcients in a second-quantized two- 
body operator that specifies the correlations. Although 
there are an equal number of unknowns and equations, in 
practice there seems to be a large degeneracy to the solu- 
tions. Nevertheless, by tackling semi-realistic problems 
they find such a high accuracy that the method seems 
exact. In this letter we analyse their method, and we 
argue that such high accuracy is intrinsic to the Jastrow 
approach underlying their calculations. In particular, we 
analyse a simple model with the aim of shedding some 
light on the issues raised above. 

In the original Jastrow approach a correlated iV- 
particle wave function is decomposed as 

*„(ri,...,rAr) (]J/(r,y))$„(ri,...,rAr) , (1) 

i<j 

where f{rij) incorporates the effects of short-range cor- 
relations between the particles, and $ is a "simple" wave 
function, typically Hartree or Hartree-Fock, which also 



incorporates internal quantum numbers such as spin, 
etc., which we collectively denote by the label "a". 

We now rewrite the product of correlation functions in 
terms of a sum, by means of an exponential representa- 
tion, 

l[f{r.j)^exp(j2<r.,)\ (2) 

The sum in the exponent can be recognized as a special 
case of a general two-body operator. If we look at state- 
dependent correlations which involve internal degrees of 
freedom as well as relative coordinates, the correlated 
wave function is characterized by a Jastrow operator, 

1*) ^ exp(f2) 1$) , (3) 

where the correlator T2 is a general two-body operator. 

In the work of Nooijen [10| it has been argued that 
Eq. Q represents the exact ground state for any two- 
body Hamiltonian. Although the examples studied re- 
cently 11, 12] provide numerical support for this method, 
they are neither rigorous nor transparent. This is par- 
tially because they involve realistic or semi-realistic ap- 
plications, where the limitations and successes of the ap- 
proach are less evident, and partially because, as in most 
quantum-chemistry problems, the results are largely per- 
turbative, and thus do not provide a rigorous test of the 
general method. 

We can easily derive the form of Jastrow's method 
introduced by Nooijen for use in a finite configuration 
space. This starts from a general Jastrow operator in 
the form T — J^i tiOi, where Oi is a complete set of two- 
body operators (we shall also include one-body operators 
in our analysis, but the principle remains the same). We 
label a complete normalised basis in the space by \n), 
with |0) = 1$). The ground-state wave function is as- 
sumed to take the form 

|*)=e^|$), H\^)^E\^U) , (4) 

where |$) is a simple reference state. One then evaluates 
the energy using a technique similar to that used in the 
coupled cluster method, 

£; = ($|e-*i?e'^ 1$) . (5) 

We now use the fact that if e'^ |0) is an eigenstate of the 
Hamiltonian, it must satisfy the equations 13] 

0= (^Je^^OiiJe^l*) -£;($] e*^d,e*l$) . (6) 

Actually, very similar equations follow from the varia- 
tional approach to the Jastrow problems. By minimising 
the energy 

($1 6**6*1$) ' 
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and using hermiticity, we get Eq. JB)), apart from the 
fact we must use Eq. ^ for E rather than the similarity 
transformed expression in Eq. 

Finally, one can use the energy relation (jSJ combined 
with completeness to write the basic equations (O in the 
form derived in Nooijen's original work 

^($|e*'6,e^|n}(n|e-^i?e*|$) =0 . (8) 

n=iO 

Since the number of equations in Eqs. H6I8|I equals the 
number of unknowns in the operator T, one might expect 
that these equations have a solution. Since the equations 
are highly non-linear, there is no general proof of this 
assertion, and its validity must depend on the nature of 
the Hamiltonian. One may argue that if |$) is close to 
an eigenfunction of H, a perturbative argument will show 
that there may well be a solution to the problem. 

One of the reasons to believe that the Jastrow method 
may be exact is based on the technique of Euclidean fil- 
tering, as disccused in Refs. 0,^3- This starts from the 
fact that the wave function 

\^b{t)) = e-"' 1$)/ ($1 e-2^t |$)i/2 

approaches the exact one as t —>■ go, and that it is obvi- 
ously a two-body correlated wave function for all finite t. 
If, in the limit t — > oo, the wave function remains a 

two-body wave function, it must be a solution to Eqs. jnj. 
For this argument to be correct, it is a necessary and suf- 
ficient condition that the set of two-body-correlated wave 
functions is complete. The non-trivial nature of such a 
statement can be seen from the fact that we try to find 
a set of finite parameters in the operator T that can de- 
scribe the same physics as obtained by the limit t ^ oo 
in Eq. 10 . Actually, what we shall do below is provide an 
indirect proof that the exact solution for a simple prob- 
lem, which by the filtering argument must also be the 
limit of \i>{t)), is not two-body correlated. 

A standard test-bed for many-body calculations is the 
Lipkin model. This is a two-level model, where fermions 
can occupy either of two levels. If we denote by a^. ^ 
the creation operator of a fermion in state i in either 
the upper (-1-) or lower level (— ), the Hamiltonian of this 
model can be written in the form 

H ^ Jo + \{jl + Jl) , (10) 

where 

^ n 

i=l 

n 

J+ = J_ -4 . (11) 

i=l 

The fact that only SU{2) generators appear means that 
we can diagonalise states within different irreps of this 



algebra; here we shall concentrate on the one with J = 
51/2. Hence we shall only be considering the states 

i^^---^+-) = \/^^^(^+rn<.|o) -(12) 

There are only a small number of two-body operators 
in the relevant space, and most of these do not respect 
the SU (2) dynamical symmetry of the Hamiltonian. This 
leads to the only allowed two-body operators being J^, 
J^, J+J-, J~J+, and Jg. The last three operators are 
overcomplete. Thus, when acting in the basis of Eq. 1)121 ') 
all three of them correspond to a quadratic function in n. 
From the combination we can then construct a constant, 
linear and quadratic piece. The constant part is irrele- 
vant for time-independent problems, and we only need 
the linear and quadratic parts. These can be reached 
with the operators Jg and Jq as well, which are what we 
shall use. The single-particle operator Jq does not seem 
to play a key role. We see no a priori reason why this op- 
erator is irrelevant in the current calculation, apart from 
the fact that in the Jastrow method one-body operators 
correspond to a general modification of the single particle 
wave functions. 

We now attempt to investigate perturbatively whether 
the result from Nooijen's method agrees with the exact 
result. We write 

oo 

t. = 5:i(")A" , (13) 

n=l 

and use as our reference state |$) = |M — — J), the ex- 
act eigenstate for A = 0. There are three ways to solve 
the problem. Firstly, we can solve Eqs. lO and lO order 
by order in A, which we shall refer to as "the solution to 
Nooijen's equations" . Alternatively, we can either com- 
bine Eq. © with Eq. (0 to "solve the variational prob- 
lem" , or we can write down the exact wave function in 
Rayleigh-Schrodinger perturbation theory, including all 
the arbitrary constants related to its normalisation, and 
require that |0) is equal to this wave function order 
by order in A (equality of wave functions) . All three ap- 
proaches only involve matrix algebra, which can easily 
be done with a computer-algebra package. The result in 
each case is very instructive. 

We look at these solutions as we vary J from 1 to 8, 
i.e., we look at even particle numbers only. The num- 
ber of wave functions mixing in the ground state is easily 
seen to be J -I- 1, so the number of parameters in the wave 
function changes from larger than the number of compo- 
nents, to much less than the number of components. Let 
us first study the equality of the wave functions. 

For J = 1,2,3 we have no problems, and all indica- 
tions are that the wave function is exact. For all the 
other cases investigated we can only have equality of the 
wave functions up to 7th order in A. If we insert this 
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wave function in the energy expressions of Eqs. H5I7|I we 
find that the energy for the similarity transformed result 
is accurate to the same order, whereas the variational 
estimate using the wave function is actually accurate to 
14th order [ij. 

The solution to Nooijen's equations is equally illumi- 
nating. First of all there appears to be an enormous 
degeneracy to these equations. An obvious source for 
such degeneracy is in the choice of normalisation of the 
wave function. Indeed, using intermediate normalisation 
drastically reduces the number of independent variables, 
but it doesn't fully lift the degeneracy. We seem to be 
able to choose the coefficient of Jq to equal zero, without 
any loss of generality. We can also impose the require- 
ments that the coefficients of and are odd in A, 
and those of Jq even. [The problems cited above are to- 
tally independent of this choice, as has been checked for 
a few representative cases.] An interesting observation is 
that the these equations have two solutions at order A®, 
one of which leads to an inconsistent set of equations at 
the next order; the other continues. In the cases J < 3 it 
continues forever, as far as we can see, and when J > 3 
the solutions terminate at order A^'^ where we again get 
an inconsistent set of equations. Surprisingly, this leads 
to a more accurate energy than above, up to order A^^ 
(which is almost, but not quite, as accurate as the Jas- 
trow method). Note, however, that the lack of a solution 
to Nooijen's equations gives rise to some problems. The 
deviations from zero may actually be hard to see if A is 
small enough, which may be an indication that for almost 
perturbative problems this is not such a bad approach af- 
ter all. 

Finally we can also solve the variational equations. It 
comes as no surprise that, whatever the number of par- 
ticles, we can solve this problem. When J > 3 the vari- 
ational energy starts deviating from the exact result at 
order A^^, as expected. 

From the simple model discussed here we can draw 
some conclusions on the use of a Jastrow-like method in 
configuration space. We have disproven the idea that 
it can be generally exact, but to our surprise it seems 
to be exact when the number of parameters in the cor- 
relation operator is larger than the number of parame- 
ters in a general wave function. Due to the non-linearity 
of the method, this is already a highly nontrivial state- 
ment. When the method breaks down the wave function 
is still correct to seventh order in perturbation theory, 
which leads to a fourteenth-order accuracy for the Jas- 
trow method. If we input this wave function into an 
estimate of the energy based on a similarity transform 
of the Hamiltonian, we get a result that is only correct 
to the same order as the wave function is correct. If 
we determine the coefficients by what we called "Nooi- 
jen's equations" the accuracy of the energy can be im- 
proved to twelfth order - only a little less accurate than 



the benchmark variational estimate! Nonetheless, if one 
deals carefully with the enormous degeneracy, numerical 
solution of the equations can be a valid approximation 
to a many-body system. The problem is that there is 
only an approximate solution to the equations, and so 
the method only works if the residual interaction is small 
in one sense or another, as is often the case in quantum- 
chemical calculations. 

In conclusion, on the one hand we have the disappoint- 
ing result that the Jastrow wave function is not in general 
exact for many-body systems interacting via two-body 
forces, in contrast to recent claims to the contrary. How- 
ever, the Jastrow wave functions proposed in the new 
method may well be so accurate that in numerical ap- 
proximations they are sufficient to obtain energies of the 
accuracy required, for example, in quantum chemistry 
calculations. It is surprising that the energy estinate of 
Eq. Q is almost as accurate as the optimal variational 
estimate of Eq. We see no intrinsic reason for this. 
Nevertheless, even when the parameters are derived from 
a solution to Nooijen's equations, its is more acuurate to 
use the variational estimate Eq. IJJ). 
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